Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SWESARR Tutorial Update #15

Merged
merged 8 commits into from
Aug 16, 2024
Merged

SWESARR Tutorial Update #15

merged 8 commits into from
Aug 16, 2024

Conversation

drboyd
Copy link
Member

@drboyd drboyd commented Aug 15, 2024

Updated SWESARR Tutorial. Includes comparison to SWE values provided by SnowExSQL and a few extra visualizations for comparing SWE and SWESARR data.

The default RAM allocation (2GB) for CryoInTheCloud can't handle the final figure generated by this notebook. This is poor memory management on my part. I've commented out the figure for the tutorial. Currently, this notebook uses roughly 1GB of RAM.

Most libraries are contained by default via CryoInTheCloud but SnowExSQL isn't. This may be an issue with merging to the main branch.

Updated SWESARR Tutorial. Includes comparison to SWE values provided by SnowExSQL and a few extra visualizations for comparing SWE and SWESARR data.

The default RAM allocation (2GB) for CryoInTheCloud can't handle the final figure generated by this notebook. This is poor memory management on my part. I've commented out the figure for the tutorial. Currently, this notebook uses 1GB of RAM.

Most libraries are contained by default via CryoInTheCloud, but SnowExSQL isn't. This may be an issue with merging to the main branch.
@drboyd drboyd requested a review from scottyhq August 15, 2024 05:43
@drboyd drboyd added the preview Create a website preview label Aug 15, 2024
Copy link

github-actions bot commented Aug 15, 2024

@drboyd
Copy link
Member Author

drboyd commented Aug 15, 2024

Hi @scottyhq, sorry for the very, very late contribution from me.

drboyd added 3 commits August 15, 2024 12:05
Looks like the website may not be rendering because snowexsql isn't available. This is definitely an inelegant way of addressing that error, but it's worth a shot at the moment.
Version of HVPlot used to render on website seems to have trouble with opacity. Using EsriReference to mitigate some of these issues.

Fixed error with radiometer data reading caused by hanging forward slash.
Fixing error caused by referencing an incorrect radiometer CSV.

Did not clear notebook outputs before uploading.
@drboyd
Copy link
Member Author

drboyd commented Aug 15, 2024

Hi @scottyhq
Website seems to render fine. I think the errors are related to hvplot rendering:
WARNING: skipping unknown output mime type: application/vnd.holoviews_load.v0+json

All the same, figures are generated A-ok for this tutorial.

For my laptop, the figures could do with some shrinking in the width to fit more cleanly on the website page. Other than that, I don't think there's any issues.

@drboyd drboyd requested a review from emacorps August 15, 2024 18:31
@scottyhq
Copy link
Member

The default RAM allocation (2GB) for CryoInTheCloud can't handle the final figure generated by this notebook.

Feel free to show people how to launch a larger server during your tutorial!

image

I think the errors are related to hvplot rendering:
WARNING: skipping unknown output mime type: application/vnd.holoviews_load.v0+json

#16 should've fixed this

Most libraries are contained by default via CryoInTheCloud but SnowExSQL isn't.

We plan to update the default image to include this and other updated libraries today or tomorrow (CryoInTheCloud/hub-image#125).

}
},
"source": [
"![NASA](http://www.nasa.gov/sites/all/themes/custom/nasatwo/images/nasa-logo.svg)\n",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This SVG isn't rendering for some reason on cryocloud

"import os, sys, glob\n",
"\n",
"swesarr_subdirs = [\"data\", \"util\"]\n",
"tmp = [sys.path.append(os.getcwd() + \"/\" + sd) for sd in swesarr_subdirs]\n",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

for tutorial data on cryocloud you'll likely have better performance downloading to /tmp (https://docs.2i2c.org/user/topics/data/)

Copy link
Member

@scottyhq scottyhq left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks @drboyd left some recommendations but feel free to merge whenever

@drboyd
Copy link
Member Author

drboyd commented Aug 16, 2024

Thanks for catching these errors, @scottyhq. I'll address these suggestions, probably tweak the size of the figures so they fit more cleanly on the website, and merge on through tomorrow. Thanks especially for the tips here and catching that dead link I glanced over.

drboyd added 2 commits August 16, 2024 13:02
* Changed NASA svg location from dead URL to Wikipedia
* Left-aligned two figures instead of centered
* Now using /tmp/ instead of local directory on Linux systems for data read/write
* Minor text updates
* Resized hvplot figures to better render on the website
@drboyd
Copy link
Member Author

drboyd commented Aug 16, 2024

Alright, I think that's everything. Thank you so much, @scottyhq !

@drboyd drboyd merged commit f3f63dd into snowex-hackweek:main Aug 16, 2024
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
preview Create a website preview
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants